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SYSTEMS AND METHODS FOR CONSTRUCTING A QUERY RESULT SET 

RELATED APPLICATION 
[0001] This application relates to Attorney Docket No. GP-175-21-US, filed 
herewith, titled "Systems and Methods for Generating a User Interface," the entirety of 
which is incorporated herein by reference. This application also relates to Attorney 
Docket No. GP-175-22-US, filed herewith, titled "Systems and Methods for Determining 
a User Interface Attribute," the entirety of which is incorporated herein by reference. 

FIELD OF THE INVENTION 
[0002] The present invention relates generally to methods and systems for query 
result presentation. The present invention relates particularly to methods and systems for 
constructing a query result set. 

BACKGROUND 

[0003] Conventional search engines receive a search query from a user and execute a 
search against a global index. Such conventional search engines typically use one or 
more conventional methods for performing a search. For example, one known method, 
described in an article entitled "The Anatomy of a Large-Scale Hypertextual Search 
Engine," by Sergey Brin and Lawrence Page, assigns a degree of importance to a 
document, such as an HTML document, based on the link structure of the HTML • 
document. The search results are often presented in a list format, comprising article 
identifiers and brief snippets about the articles in an HTML document that can be resized. 
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[0004] In a conventional user interface, the window comprising the search results 
may be layered on top of other windows or may be covered by other windows. In either 
case, information that may be of interest to the user is obscured. In order to avoid the 
visual interference in the user interface, the user can manually adjust attributes of the 
display, such as the position and size of a window, to alleviate interference between 
windows. 

[0005] Conventional interface may also provide a capability to adjust the relation of 
all windows displayed in the interface. For example, in the Microsoft® Windows 
environment, all the windows in the interface may be layered, cascaded, or arranged so 
that the windows together fill the entire screen. Conventional applications do not provide 
a means to adjust the size of a particular window based on the combination of windows 
currently displayed in the user interface in an effective manner. 

[0006] Thus, a need exists to provide an improved system and method for 
determining a user interface attribute. 

SUMMARY 

[0007] Embodiments of the present invention provide systems and methods for 
constructing a query result set. In one embodiment of the present invention, a display 
processor or query system refreshes a first result set; the first result set comprising a first 
plurality of article identifiers based on a second result set; the second result set 
comprising a second plurality of article identifiers. The display processor or query 
system then creates a third result set, the third result set based at least in part on the first 
result set and the second result set. In one embodiment, creating the third result set 
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comprises constructing the first result set based at least in part on the second plurality of 
article identifiers. In another embodiment, creating the third result set comprises 
constructing the second result set based at least in part on the first plurality of article 
identifiers. In one embodiment, the second plurality of article identifiers is then 
displayed. Embodiments of the present invention present a consistent and effective 
content display to the user. 

[0008] These exemplary embodiments are mentioned not to limit or define the 
invention, but to provide examples of embodiments of the invention to aid understanding 
thereof. Exemplary embodiments are discussed in the Detailed Description, and further 
description of the invention is provided there. Advantages offered by the various 
embodiments of the present invention may be further understood by examining this 
specification. 

BRIEF DESCRIPTION OF THE FIGURES 
[0009] These and other features, aspects, and advantages of the present invention are 
better understood when the following Detailed Description is read with reference to the 
accompanying drawings, wherein: 

Figure 1 is a block diagram illustrating an exemplary environment in which 
one embodiment of the present invention may operate; 

Figure 2 is a flowchart illustrating generating a user interface in one 
embodiment of the present invention; 

Figure 3 is a screen shot illustrating information displayed in an HTML 
document in one embodiment of the present invention; 
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Figure 4 is a screen shot illustrating information displayed in a Microsoft® 
Word toolbar in one embodiment of the present invention; 

Figure 5 is a screen shot illustrating information displayed in a floating title 
bar in one embodiment of the present invention; 

Figure 6 is a block diagram of a user display in one embodiment of the present 

invention; 

Figure 7 is a block diagram of a user display including a content display in 
one embodiment of the present invention; 

Figure 8 is a flowchart illustrating a process for identifying available screen 
area and sizing the content display accordingly in one embodiment of the present 
invention; and 

Figure 9 is a flowchart illustrating a process of reordering a result set in one 
embodiment of the present invention; 

Figure 10 is a screen shot illustrating information displayed in a hovering bar 
in one embodiment of the present invention; and 

Figure 1 1 is a screen shot illustrating information displayed in a side bar in 
one embodiment of the present invention. 



DETAILED DESCRIPTION 
[0010] Embodiments of the present invention provide systems and methods for 
generating a user interface. Referring now to the drawings in which like numerals 
indicate like elements throughout the several figures, Figure 1 is a block diagram 
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illustrating an exemplary environment for implementation of an embodiment of the 
present invention. While the environment shown reflects a client-side search engine 
architecture embodiment, other embodiments are possible. The system 100 shown in 
Figure 1 includes multiple client devices 102a-n in communication with a server device 
150 over a network 106. The network 106 shown comprises the Internet. In other 
embodiments, other networks, such as an intranet, may be used instead. Moreover, 
methods according to the present invention may operate within a single client device. 

[0011] The client devices 102a-n shown each includes a computer-readable medium 
108. The embodiment shown includes a random access memory (RAM) 108 coupled to a 
processor 110. The processor 110 executes computer-executable program instructions 
stored in memory 108. Such processors may include a microprocessor, an ASIC, a state 
machine, or other processor, and can be any of a number of computer processors, such as 
processors from Intel Corporation of Santa Clara, California and Motorola Corporation of 
Schaumburg, Illinois. Such processors include, or may be in communication with, 
media, for example computer-readable media, which stores instructions that, when 
executed by the processor, cause the processor to perform the steps described herein. 
Embodiments of computer-readable media include, but are not limited to, an electronic, 
optical, magnetic, or other storage or transmission device capable of providing a 
processor, such as the processor 1 10 of client 102a, with computer-readable instructions. 
Other examples of suitable media include, but are not limited to, a floppy disk, CD-ROM, 
DVD, magnetic disk, memory chip, ROM, RAM, an ASIC, a configured processor, all 
optical media, magnetic tape or other magnetic media, or any other medium from which a 
computer processor can read instructions. Also, various other forms of computer- 
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readable media may transmit or carry instructions to a computer, including a router, 
private or public network, or other transmission device or channel, both wired and 
wireless. The instructions may comprise code from any computer-programming 
language, including, for example, C, C++, C#, Visual Basic, Java, Python, Perl, and 
JavaScript. 

[0012] Client devices 102a-n can be connected to a network 106 as shown, or can be 
stand-alone machines. Client devices 102a-n may also include a number of external or 
internal devices such as a mouse, a CD-ROM, DVD, a keyboard, a display, or other input 
or output devices. Examples of client devices 102a-n are personal computers, digital 
assistants, personal digital assistants, cellular phones, mobile phones, smart phones, 
pagers, digital tablets, laptop computers, Internet appliances, and other processor-based 
devices. In general, the client devices 102a-n may be any type of processor-based 
platform that operates on any operating system, such as Microsoft® Windows® or Linux, 
capable of supporting one or more client application programs. For example, the client 
device 102a shown comprises a personal computer executing client application programs, 
also known as client applications 120. The client applications 120 can be contained in 
memory 108 and can include, for example, a word processing application, a spreadsheet 
application, an e-mail application, an instant messenger application, a presentation 
application, an Internet browser application, a calendar/organizer application, a document 
viewer application, and any other application capable of being executed by a client 
device. 
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[0013] The user 1 12a can interact with the various client applications 120 and articles 
associated with the client applications 120 via various input and output devices of the 
client device 102a. Articles include, for example, word processor, spreadsheet, 
presentation, e-mail, instant messenger, database, Internet browser, document view, and 
other client application program content files or groups of files, web pages of various 
formats, such as HTML, XML, XHTML, Portable Document Format (PDF) files, and 
audio files, video files, or any other documents or groups of documents or information of 
any type whatsoever. 

[0014] The user's 1 12a interaction with articles, the client applications 120, and the 
client device 102a creates event data that may be observed, recorded, analyzed or 
otherwise used. An event can be any occurrence possible associated with an article, 
client application 120, or client device 102a, such as inputting text in an article, selecting 
text in an article, sending an article, receiving an article, manipulating an input device, 
opening an article, saving an article, closing an article, highlighting a selection within an 
article, hovering the mouse over words in an article, opening a client application 
program, closing a client application program, idle time, processor load, disk access, 
memory usage, and any other possible occurrence associated with an article, a client 
application program, or the client device whatsoever. 

[0015] The memory 108 of the client device 102a shown also contains a capture 
processor 124, a queue 126, and a search engine 122. The client device 102a shown also 
contains or is in communication with a data store 140. The capture processor 124 can 
capture events and pass them to the queue 126. The search engine 122 requests events 
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from the queue 126 when the search engine 122 is ready to process the events. The 
queue 126 may also notify the search engine 122 when events are available. When the 
search engine 122 receives an event it can be processed and can be stored in the data 
store 140. The search engine 122 can receive an explicit query from the user 1 12a or 
generate an implicit query and retrieve information from the data store 140 in response to 
the query. 

[0016] In the embodiment shown, the capture processor 124 comprises multiple 
capture components. For example, the capture processor 124 shown comprises a separate 
capture component for each client application in order to capture event data associated 
with each application. In general, a capture component may monitor one or more 
applications, and one or more capture components may monitor a particular application. 
The capture processor 124 shown also comprises a separate capture component that 
monitors overall network activity in order to capture event data associated with network 
activity, such as the receipt of an instant message. The capture processor 124 shown also 
comprises a separate capture component that monitors overall client device performance 
data, such as processor load, idle time, disk access, the client applications in use, and the 
amount of memory available. The capture processor 124 shown also comprises a 
separate capture component to monitor and capture keystrokes input by the user. 

[0017] The capture processor 124 can capture events in real time or real time events 
and can capture events that have occurred in the past or historical events. Real time 
events can be loading, saving, or viewing an article, such as opening a word processing 
document, viewing a web page, viewing an email, and saving an MP3 file, and updating 
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the metadata of an article, such as bookmarking a web page, printing a presentation 
document, deleting a word processing document, and moving a spreadsheet document. 

[0018] Historical events are similar to real time events except that the event occurred 
before the installation of the search engine 122 or was otherwise not captured, because, 
for example, the search engine 122 was not operational for a period of time while the 
client device 102a was operational. Examples of historical events include the user's 
saved word processing documents, spreadsheets, presentations, the emails in a user's 
inbox, and the web pages bookmarked by the user. 

[0019] The search engine 122 shown contains an indexer 130, a query system 132, 
and a formatter 134. Real time events can be provided by the queue 126 to the query 
system 132 upon request to provide the query system 132 with information concerning 
current user context. The queue 126 may also notify the query system 132, and the 
indexer 130, when new events are available. In one embodiment, performance data is 
stored in a performance management system (not shown) rather than in the queue 126. 
The performance management system is available to any component that requires access 
to current performance data. The query system 132 can use information from the queue 
126 to generate an implicit query. The query system 132 can also receive and process 
explicit queries from the user 1 12a. 

[0020] In the embodiment shown, real time events and historical events are sent by 
the queue 126 to the indexer 130. In one embodiment, not all contextual real time events 
are indexed and these events are not sent to the indexer 130. The indexer 130 can index 
the indexable real time events and historical events and can send them to the data store 
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140 where they are stored. The data store 140 can be any type of computer-readable 
media and can be integrated with the client device 102a, such as a hard drive, or external 
to the client device 102a, such as an external hard drive or on another data storage device 
accessed through the network 106. The data store 140 may include any one or 
combination of methods for storing data, including without limitation, arrays, hash tables, 
lists, and pairs. In the embodiment shown, the data store comprises a messaging index 
142, an article index 143, a database 144 and a repository 146. 

[0021] In the embodiment shown, a user 1 12a can input an explicit query into a 
search engine interface displayed on the client device 102a, which is received by the 
search engine 122. The search engine 122 can also generate an implicit query based on a 
current user context or state, which can be determined by the query system 132 from 
contextual real time events. Based on the query, the query system 132 can locate relevant 
information in the data store 140 and provide a result set. In one embodiment, the result 
set comprises articles associated with the client applications 120 or client articles. Client 
articles stored in the article index 143 include articles associated with the user 1 12a or 
client device 102a, such as the word processing documents, previously viewed or any 
other article associated with the client device 102a or user 1 12a. In another embodiment, 
the result set also comprises articles located on the network 106 or network articles 
located by a search engine on a server device. Network articles include articles located 
on the network 106 not necessarily previously viewed or otherwise referenced by the user 
1 12a, such as web pages not previously viewed by the user 1 12a. 
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[0022] Articles stored in the messaging index 142 include one or more types of 
messages, such as a user's emails, chat messages, and instant messaging messages. Each 
time a message is received, sent, modified, printed, or otherwise accessed, a record is 
stored in the messaging index 142. This information can later be searched to identify 
messages that should be displayed in the user interface. 

[0023] An embodiment of the present invention may also store message threads in the 
messaging index 142. In such an embodiment, messages are related together by various 
attributes, including, for example, the sender, recipient, date/time sent and received, the 
subject, the content, or any other attribute of the message. The related messages can then 
be retrieved as a thread, which may be treated as a document by the display processor 
128. 

[0024] The formatter 134 can receive the search result set from the query system 132 
of the search engine 122 and can format the results for output to a display processor 128. 
In one embodiment, the formatter 134 formats the results in XML or HTML. The display 
processor 128 can be contained in memory 108 and can control the display of the result 
set on a display device associated with the client device 102a. The display processor 128 
may comprise various components. For example, in one embodiment, the display 
processor 128 comprises a hypertext transfer protocol (HTTP) server that receives 
requests for information and responds by constructing and transmitting hypertext markup 
language (HTML) pages. In one such embodiment, the HTTP server comprises a scaled- 
down version of the Apache Web server. 
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[0025] Through the client devices 102a-n, users 1 12a-n can communicate over the 
network 106, with each other and with other systems and devices coupled to the network 
106. As shown in Figure 1, a server device 150 may also be coupled to the network 106. 
In the embodiment shown, the search engine 122 can transmit a search query comprised 
of an explicit or implicit query or both to the server device 150. The user 1 12a can also 
enter a search query in a search engine interface, which can be transmitted to the server 
device 150. In another embodiment, the query signal may instead be sent to a proxy 
server (not shown), which then transmits the query signal to server device 150. Other 
configurations are also possible. 

[0026] The server device 150 shown includes a server executing a search engine 
application program, such as the Google™ search engine. Similar to the client devices 
102a-n, the server device 150 shown includes a processor 160 coupled to a computer- 
readable memory 162. Server device 150, depicted as a single computer system, may be 
implemented as a network of computer processors. Examples of a server device 150 are 
servers, mainframe computers, networked computers, a processor-based device, and 
similar types of systems and devices. The server processor 160 can be any of a number 
of computer processors, such as processors from Intel Corporation of Santa Clara, 
California and Motorola Corporation of Schaumburg, Illinois. 

[0027] Memory 162 contains the search engine application program, also known as a 
search engine 170. . The search engine 170 locates relevant information in response to a 
search query from a client device 102a. The search engine 120 then provides the result 
set to the client device 102a via the network 106. The result set 134 comprises one or 
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more article identifiers. An article identifier may be, for example, a uniform resource 
locator (URL), a file name, a link, an icon, a path for a local file, or anything else that 
identifies an article. In the embodiment shown, an article identifier comprises a URL 
associated with an article. 

[0028] In the embodiment shown, the server device 150, or related device, has 
previously performed a crawl of the network 106 to locate articles, such as web pages, 
stored at other devices or systems connected to the network 106, and indexed the articles 
in memory 162 or on another data storage device. 

[0029] It should be noted that alternative embodiments of the present invention may 
comprise systems having different architecture than that which is shown in connection 
with the exemplary embodiment shown in Figure 1 . For example, in one embodiment, 
the server device 104 may comprise a single physical or logical server, or there may be 
no server. The system 100 shown in Figure 1 is merely exemplary, and is used to explain 
the exemplary methods shown in Figures 2, 7, and 8. 

[0030] Various methods may be implemented in the environment shown in Figure 1 
and other environments according to the present invention. In one embodiment of the 
present invention, the display processor 128 receives a first result set comprising one or 
more article identifiers from a messaging index in response to a search query. For 
example, in one embodiment, if a user 1 12a is editing a document and types the term 
"laptop" into the title, the display processor 128 receives a result set from the messaging 
index that includes article identifiers in the messaging index 142 that are relevant, as 
determined by the search engine 122, to the term "laptop." The article identifiers may 
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include links to email threads, chat messages, instant messages, and other messaging 
articles. 

[0031] Next, in this embodiment, the display processor 128 receives a second result 
set comprising an article identifier from an article index in response to the search query. 
For example, the display processor receives a result set that includes article identifiers in 
the article index that are relevant, as determined by the search engine 122, to the term 
"laptop." The article index 143 may include, for example, an index of word-processor 
documents, and the article identifiers may include links to the documents. 

[0032] In this embodiment, the display processor 128 next generates a user interface 
comprising the first article identifier and the second article identifier. The display 
processor may, for example, generate an HTML document or other document that may be 
viewed in a browser, the document including both the article identifiers from the 
messaging index and the article index so that the user can easily access either or both of 
the articles associated with the article identifiers. 

[0033] The messaging index 142 may comprise at least one of a chat message 
identifier, an email message identifier, an instant message identifier, or other messaging 
article. The messaging index 142 may comprise article identifiers for any messaging- 
related articles. Indexes other than an article or messaging index may also be utilized. 

[0034] In one embodiment, the search query that the search engine 122 executes 
against the indexes is a user context-dependent search query. The context in which the 
user 1 12a is operating may be determined based on the client applications 120 that the 
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user 1 12a is executing, the content of the files on which the user 1 12a is operating, or 
other activity or event occurring on the client 102a. The user context may comprise, for 
example, a user action history comprising a plurality of user actions. Each user action 
comprises various parameters, including, for example, a date/time parameter. For 
example, if the user 1 12a prints a word-processing document multiple times in a short 
period of time, the queries against the messaging and article indexes may be related to the 
content of the document the user 1 12a printed. 

[0035] The queries against the messaging and article indexes may be created using a 
combination of user actions. For example, if the user prints a word-processing document 
and also highlights a selection of words within that document, the queries generated may 
be a combination of content from the entire printed document and the highlighted words. 

[0036] The user interface may comprise a content display. The content display may 
be constructed as, for example, an HTML document, add-in, or horizontal or vertical 
toolbar. The display processor 128 generates the user interface with the articles 
identifiers. In one embodiment, the article identifiers comprise one or more of a title, 
URL, text snippet or thumbnail associated with the each article identifier. For example, 
in one embodiment, the display processor generates a user interface as an HTML 
document resembling a conventional search engine results page. In such an embodiment, 
each article identifier includes one or a combination of: a URL or path corresponding to 
the article, and a text snippet summarizing or otherwise associated with the article to 
which the article identifier refers. 
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[0037] One embodiment of the present invention provides a method for automatic 
construction and placement of the user interface. In one such embodiment, the display 
processor 128 receives a trigger to display a content display in a user interface, detects an 
area of the user interface comprising non-primary content, and creates a content display 
comprising an attribute associated with the area of the user interface comprising non- 
primary content. The attribute may comprise, for example, the size, height, width, 
position, transparency, or other attribute of the content display. The display processor 
128 may alter the size or position of the content display when other elements in the 
display are moved or resized. 

[0038] In one embodiment, automatically sizing and positioning the content display 
may comprise resizing existing windows in the display to create an area in which to 
create the content display. For example, if a client application is currently maximized, 
the display processor 128 may call that applications window restore command to clear 
space somewhere on the display for the content window. Alternatively, the display 
processor 128 may explicitly set position and size parameters for the display of a client 
application to make room for the content display. 

[0039] Various methods of detecting an area or non-primary content may be utilized 
by an embodiment of the present invention. For example, in one embodiment, the 
display processor identifies changes in pixel brightness and/or color as an indicator of 
where primary or non-primary content is displayed on the display. A large change in 
pixel brightness and/or color indicates a transition between an area where content is 
located and one where no content is located. In one embodiment, the largest empty 
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section at the top of a window is located near the title bar, menu bar, and any task bars. 
The content display may be placed overlaying the titlebar/menubar/taskbar area of a 
window even though that is not the largest area of non-primary content on the screen. 
Once an embodiment identifies an area with content, it determines whether the content is 
primary content or non-primary content. 

[0040] For example, in one embodiment of the present invention, a display processor 
128 detects an area at the top of a user interface that includes only one small area of 
content in a large rectangular area. The display processor 128 queries the operating 
system using the position of a pixel with in the small area of content to determine what is 
located in the identified position. The operating system provides information in response 
that indicates to the display processor 128 that the content comprises an application icon. 
The display processor 128 concludes that the content is non-primary content according to 
rules in the program and/or preferences provided by the user. Accordingly, the display 
processor 128 constructs a content display that fits within the large rectangular area 
comprising non-primary content. 

[0041] Another embodiment of the present invention provides methods and systems 
for reconstructing the results of searches. Reconstructing may provide a more consistent 
content display to the user, may help to ensure that the most relevant results are displayed 
in the content display, or may otherwise help to increase the effectiveness of the content 
display. In one embodiment, the display processor 128 receives a request to refresh a 
first result set comprising a first plurality of article identifiers. For example, the display 
processor 128 may periodically (e.g., every five minutes) refresh the list of article 
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identifiers in a content display. To do so, the display processor 128 may receive a second 
result set comprising a second plurality of article identifiers. The display processor 128 
then creates a third result set based at least in part on the first result set and the second 
result set. Creating the third result set may comprise reconstructing the first result set or 
reconstructing the second result set. The display processor 128 then causes the third 
result set to be displayed in place of the first result set. Embodiments of the present 
invention may utilize one or more previous result sets in constructing or reconstructing a 
result set. 

[0042] For example, in one embodiment, when a content display requests a refresh, a 
display processor 128 issues a search query to the search engine 122. The search query 
may be identical to the query initially issued to the search engine 122 to populate the 
content display or may be altered based on the current context of the user or for some 
other reason. The display processor 128 receives the second result set from the search 
engine 122 and compares the article identifiers in the second result set to the article 
identifiers in the first result set. The result sets may be identical, or the display processor 
128 may identify article identifiers that are in one result set and not in the other, or may 
identify article identifiers that are in both but are in different positions. If the same article 
identifiers are in both result sets, but the result sets are not identically sorted, the display 
processor 128 according to one embodiment of the present invention, sorts the second 
result set based at least in part on the sort order of the first result set. For example, the 
user 1 12a may be viewing a sub-set of the first result set, e.g., identifiers 20-30 in the first 
result set at the time of the refresh. The display processor 128 may create the third result 
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set by sorting the second result set such that the same article identifiers appear in spaces 
20-30. In this way, when the refresh occurs, the user's then-view is not unduly disturbed. 

[0043] Sorting the second result set may comprise, for example, identifying a first 
article identifier in a first position in the first result set, identifying the first article 
identifier in a second position in the second result set, and relocating the first article 
identifier to the first position in the second result set. 

[0044] In one embodiment, the display processor 128 creates the third result set by 
deleting an article identifier from the second result set based on an event associated with 
the article identifier in the first result set. For example, if the article identifier in the first 
result set has appeared in the content display numerous times but has not been clicked by 
the user, the display processor 128 in such an embodiment may delete the article 
identifier from the second result set. In other embodiments, other events serve as 
indicators that an article can be deleted from the result set. 

[0045] In another embodiment of the present invention, the display processor 128 
replaces article identifiers in the first result set with article identifiers in the second set. 
In one such embodiment, the display processor receives a request to refresh a first result 
set comprising a first plurality of article identifiers, receives a second result set 
comprising a second plurality of article identifiers, and identifies a first article identifier 
in the first result set that is not in the second result set. The display processor then 
identifies a second article identifier in the second result set that is not in the first result set 
and replaces the first article identifier in the first result set with the second article 
identifier. The entire first result set is not replaced; only specific article identifiers are 
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replaced. In this way, the display processor 128 minimizes changes to the interface, 
resulting in greater constancy and fewer distractions for the user. Zero, one, or more 
article identifiers in the content display may be replaced during any one refresh. 

[0046] The terms first, second, and third are used here merely to differentiate one 
item from another item. The terms first, second, and third are not used to indicate first, 
second, or third in time, or first, second, or third in a list, or other order, unless explicitly 
noted. For example, the "second" may come in time or in list before the "first," unless it 
is otherwise explicitly indicated. 

[0047] Figure 2 is a flowchart illustrating generating a user interface in accordance 
with one embodiment of the present invention. In the embodiment shown, the query 
system 132 receives a search query 202. The query may be an explicit query, e.g., a 
query entered by a user 1 12a in a text box, or the query may instead be an implicit query 
generated by a client application 120 in response to events associated with the user 1 12a, 
for example, information being entered by or output to the user. The query or the 
response to the query may additionally depend on user context. For example, the 
response to the query may depend on the time of day the query is run or on previous or a 
sequence of previous actions by the user. In one embodiment, the current user context is 
derived from a data store comprising a history of user actions, such as printing or opening 
a file, or sending an email message. 

[0048] In response to receiving the query, the query system 132 executes the search 
query on a messaging index 142 stored in the data store (140) 204. The query system 132 
then receives the result set from the messaging index 206. The messaging index may 
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comprise information regarding, for example, chat messages, emails, and instant 
messages. The result set comprises one or more article identifiers and may comprise 
snippets or text summaries of the article with which the article identifier is associated. 

[0049] The query system 132 then executes the search query on an article index 
stored in the data store (140) 208. The query system 132 receives the result set from the 
article index 210. The result set comprises one or more article identifiers that satisfy the 
search query. In the case of a file, the article identifier may be a fully qualified path. The 
query system 132 then ranks the article identifiers in each of the two result sets 212 (this 
may be done separately and then combined or combined and then ranked). The query 
system 132 may perform queries on additional indexes, such as an index comprising 
news articles or any other type of document or file that can be indexed. The query 
system 132 may also cause queries to be executed on indexes not stored on the client 
102a or in the data store 140. For example, in one embodiment, the query system 132 
causes queries to be executed on the search engine 170. 

[0050] In the embodiment shown, the query system 132 transmits the result sets to 
the display processor 128, which combines the result sets 214. The display processor 128 
may combine the result sets into one comprehensive list or may combine the result sets 
into one interface (shown together or separately). In one embodiment in which the result 
sets are combined into one interface but not into an integrated list, the display processor 
128 creates tabs on the user interface into which the article identifiers are arranged. The 
tabs may include, for example, an email tab, an instant message tab, a web page tab, a 
news tab, and/or a file tab. 
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[0051] In the embodiment shown, the display processor 128 next constructs a content 
display comprising the two result sets 216. The content display may comprise text 
describing the article identifier, a thumbnail image of the article, or any other information 
that would be useful to the user 1 12a in identifying a potentially relevant result. The 
display processor then causes the content display to be displayed 218. The functions 
described may be performed by other components of an embodiment of the present 
invention. For example, in one embodiment, the query system 132 and display processor 
128 are combined, and the combined component performs functions necessary to 
facilitate execution of queries, ranking of result sets, and causing the display of the 
combined results. Other configurations are also possible. 

[0052] The content display that the display processor 128 constructs in step 216 of 
Figure 2 may take of a number of forms. For example, in one embodiment, the display 
processor 128 constructs an HTML document comprising various sections, each section 
comprising results from a different index. In another embodiment, the information from 
various indexes is combined into a single, integrated listing. The display may be 
periodically updated (e.g., daily) or updated substantially continuously. 

[0053] Figure 3 is a screen shot illustrating information displayed in an HTML 
document in one embodiment of a content display 301 constructed according to the 
method shown in Figure 2. The content display 301 shown comprises an HTML 
document. The HTML document 301 comprises two sections. 

[0054] The first section 302 comprises a result set comprising email threads retrieved 
from a messaging index 142. The article identifiers are retrieved from the messaging 
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index 142 as described in relation to steps 204 and 206 in Figure 2. In the embodiment 
shown, the email thread comprises a series of related messages. The messages may be 
related by sender, recipient, subject, and/or content of the message, or based on other 
attributes of the message. Taken together, the email messages form a thread, a type of 
article or document that the user 1 12a can access. In another embodiment, messages may 
be shown in this section; the messages may or may not be email messages or threads. 

[0055] The result set in the shown in the first section 302 also comprises chat 
messages or chat message threads retrieved from a messaging index 142. The email and 
chat messages may be retrieved simultaneously by the search engine 122 or may be 
retrieved separately by repeating steps 204 and 206 for each section type. 

[0056] The second section comprises a result set or a portion of a result containing 
results from the Internet 304. In the process illustrated in Figure 2, the Internet represents 
a remote article index. In another embodiment, the Internet represents results from an 
index of pages viewed in the past as described in relation to steps 208 and 210. 

[0057] The second section 304 of the embodiment shown also comprises a result set 
comprising files retrieved from an article index 143. The search engine 120 may retrieve 
the article identifiers associated with both the files and other articles in a single step. 
Alternatively, the search engine 120 may execute steps 208 and 210 repeatedly to retrieve 
various types of articles. 

[0058] The two sections 302, 304 and the layout of the display shown in Figure 3 are 
merely exemplary of how an HTML document may be constructed according to the 
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present invention. For example, a user 1 12a may select different, fewer, or additional 
categories to display on the HTML document. In one embodiment, the user 1 12a 
accesses an administration page to vary the layout of the HTML document shown in 
Figure 3 as desired. 

[0059] An embodiment of the present invention may construct the content display as 
a part of another application. For example, many products that execute within the 
Microsoft® Windows environment include a toolbar. These applications often include 
the capability to support add-ins. Figure 4 is a screen shot illustrating a content display 
402 according to one embodiment of the present invention constructed as a Microsoft® 
Word toolbar. 

[0060] In the embodiment shown, the display processor 128 constructs a content 
display 402 that appears as an add-in in Microsoft® Word. The display processor 
executes the steps in Figure 2 to retrieve article identifiers from the messaging index 142 
according to steps 204 and 206, and article identifiers from the article index 143 
according to steps 208 and 210. As described in relation to Figure 3, the steps shown in 
Figure 2 may be executed in various orders and any of the steps may be repeated alone or 
in combination with other steps to generate the content display shown in Figure 3. The 
display may appear as an add-in to other applications, such as Microsoft® Excel, 
Microsoft® Powerpoint, Microsoft® Internet Explorer, or other products. 

[0061] The content display 402 shown is a vertical representation of the various data. 
The content display 402 appears between the last toolbar 404 and the document displayed 
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406. The content display 402 may be displayed in various sections of the application 
window in embodiments of the present invention. 

[0062] In the embodiment shown, the content display 402 appears as a standard add- 
in. In another embodiment, the display processor 128 constructs the content display 402 
so that it appears similar to the one shown in Figure 4. However, rather than causing the 
display to be displayed as an add-in, the display processor 128 causes the content display 
402 to be shown in the same spot as an add-in would normally be shown, displacing any 
portion of the application that would be obscured by the content display 402. For 
example, in one application that does not support add-ins, the display processor 
determines the position of the title bar 404 and of the content screen of the application, 
section 406 in the embodiment shown, and causes the content display 402 to be shown 
between the two sections. The display processor 128 automatically repositions the 
content display 402 when the application is moved or resized. In another embodiment, 
the content display may overlay a region of the current window or screen, without 
displacing any content. For example, the content display may appear in the titlebar, 
menubar, or toolbar region of the window where no content is displayed. 

[0063] Figure 5 is a screen shot illustrating information displayed in a floating title 
bar in one embodiment of a content display constructed according to methods of the 
present invention. In the embodiment shown, the title bar 502 comprises information 
retrieved from the messaging 142 and article indexes 143 according to the process shown 
in Figure 2. The information in the embodiment shown is constructed so as to be 
displayed horizontally. The content display 502 includes a series of tabs 504 that allow a 
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user 1 12a to select the information to be displayed. For example, in the embodiment 
shown, the user 1 12a can select from All, Mail, Web, Files, Chat, Commands, 
Multimedia, and Related tabs. Each of the tabs corresponds to the type of information to 
be displayed in the content display 502. As described in relation to Figure 2, the display 
processor may repeat the steps 204-210 in Figure 2 for each type of content to be 
displayed or may instead execute the steps in Figure 2 and then determine appropriate 
categories in which to place each of the resulting article identifiers. 

[0064] Although in the embodiment shown in Figure 5 the display processor 128 
constructs the title bar 502 to be displayed horizontally, in one embodiment of the present 
invention, the display processor 128 constructs the title bar 502 so that it may be 
displayed vertically, e.g., along the right side of the display area on the screen. Such an 
embodiment may include vertical or horizontal tabs or may instead include sections for 
each of the types of data shown. The title bar 502 may be adjustable in size by the user, 
such that its width and height may be changed via dragging by the mouse or some other 
mechanism to be different from its original settings. 

[0065] Various other types of displays may be employed by various embodiments of 
the present invention. For example, Figure 10 is a screen shot illustrating information 
displayed in a hovering bar in one embodiment of the present invention. Figure 1 1 is a 
screen shot illustrating information displayed in a side bar in one embodiment of the 
present invention. 

[0066] In one embodiment of the present invention, the display processor 
automatically constructs the user interface page based on the space available on the 
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display screen. In one such embodiment, the display processor attempts to identify a 
section of the screen in which non-primary content is displayed. The display processor 
128 then constructs the page to fit in the space. Figures 6 through 8 illustrate one method 
to allow for such fit-to-space construction. 

[0067] Figure 6 is a block diagram of a computer display comprising areas with and 
without content in one embodiment of the present invention. Although areas are 
described as having non-primary content in the embodiments described, the invention 
may be used in relation to areas with little, irrelevant, or unused content. For example, 
such non-content areas may comprise areas in which the computer desktop or in which 
only icons are viewable. In the embodiment shown, a display 602 currently comprises 
two application windows 604, 606. The first window 604 comprises Application 1, and 
the second window 606 comprises Application 2. The display 602 also comprises a 
menu bar 608. These areas 604, 606, and 608 have content (such as text and graphics) 
present. 

[0068] The display 602 includes a number of areas in which non-primary content is 
present. The largest of these areas is at the top of the screen 610. In one embodiment, 
the display processor 128 is able to construct a content display to fit in the area 610 that 
does not include any content. 

[0069] Figure 7 is a block diagram of the user display shown in Figure 6 including a 
content display in one embodiment of the present invention. In the embodiment shown, 
the display processor 128 has identified an area at the top of the display in which the 
content display 702 may be placed. Accordingly, the display processor sizes and 
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positions the content display 702 to fit in the area with non-primary content 610. 
In one embodiment of the present invention, the display processor 128 uses the following 
method to locate a position to display a content window overlaying the 
titlebar/menubar/taskbars of an application window: 

whenever there is a change in the size or position of the currently focused window, or a 
change in the content of the window near a content display, or the user switches to a 
different window then the following analysis is performed to locate the position to 
display the content window: If the window is large enough to accommodate the 
minimize sized content display then the display processor retrieves an image of the 
focused window, including the titlebar/menubar/taskbar region. 

[0070] For each row in the retrieved image from the top to the maximum height of 
the content display or until the row cannot accommodate a content display of the 
minimum width, perform the following: find the widest region where the change in pixel 
brightness and/or color over a specified range (typically a small number of pixels) does 
not exceed a threshold. For example, in one such embodiment, the threshold is equal to 
the sum of the absolute values of the differences between the R, G, and B values of the 
pixels. Next, analyze the widest regions from each line to find the best size of the content 
display. Typically, the higher the window is, the less wide it can be as since toolbars 
often include more content at lower points. 
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[0071] In one embodiment, the content display remains rectangular. In such an 
embodiment, the content display is either narrow and tall or shorter and allowing it to be 
wider. A heuristic may be used to choose the best size. 

[0072] In one embodiment of the present invention, the display processor 128 
consults a list of preferences or pre-defined areas that affect the display of the content 
window. For example, in one embodiment, the display processor 128 accesses a list of 
windows to never show the content display on (blacklist), a list of windows to show the 
content display on (whitelist), and/or a list of windows to limit the height of the content 
display to specified values. The display processor 128 may rely on other attributes of the 
display to determine how to create the content display window. For example, in one 
embodiment, the display processor 128 identifies entry fields in dialog boxes and avoids 
having the content display overlap these fields. 

[0073] Figure 8 is a flowchart illustrating a process for identifying available screen 
area and sizing the results window accordingly in one embodiment of the present 
invention. In the embodiment shown, the display processor 128 receives a trigger to 
display a content display (such as those shown in Figures 3, 4, and 5) 802. The trigger 
may comprise, for example, the passage of a predetermined time period or a notification 
that a window in the user interface has been resized. In response, the display processor 
128 examines the current layout of the computer display 804. The layout of the computer 
display comprises the layout of the windows comprising primary and non-primary 
content as well as the background and any icons or other elements in the display. 
Primary content comprises, for example, windows in which the user is actively or has 
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recently been working, toolbars that are active or have recently been active, and any other 
content that is identified as content that should not be covered by the content display. 
The display processor 128 searches for and detects an area with non-primary content if 
such an area exists 806. The area with non-primary content may, for example, comprise 
only background or may comprise background and application program icons. In one 
embodiment, the area with non-primary content comprises an application window that 
has been inactive for more than a predetermined time period, e.g., five minutes. 

[0074] The display processor 128 may detect an area with non-primary content in a 
variety of ways. For example, in one embodiment, the display processor 128 evaluates 
the color and/or brightness of the pixels within the display to detect changes. In one such 
embodiment, the display processor 128 determines the color of the background and then 
evaluates pixels to detect pixels that comprise a color different than the background color. 
If the display processor 128 detects such a pixel, it concludes that content exists in that 
pixel. If the color is the same as the background, the display processor 128 detects an 
absence of content. 

[0075] If the display processor 128 detects content, then the display processor 128 
must further determine whether the content is primary content. The display processor 
128 may determine whether content is primary by locating a pixel with content and then 
using the position of the pixel to determine what type of content is displayed at that 
position. For example, the display processor 128 may make an operating system call to 
determine which application or applications are displaying content at the position. The 
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display processor 128 then uses the supplied information to make a determination of 
whether or not the content is primary. 

[0076] In another embodiment, the display processor 128 evaluates the color and/or 
brightness intensity of various pixels. Large or sudden changes in intensity between 
pixels or over a range covering a specified size or number of pixels indicate that content 
may be present in the more intense pixel. For example, there are often large changes in 
color and/or intensity at the edges of characters. The background may change smoothly 
to show a shaded appearance - by looking for large or sudden changes we are able to 
ignore relatively slow gradual changes as typical for backgrounds. Anti-aliasing may 
cause the color and/or intensity to vary smoothly at the edge of items like characters, in 
which case it may be necessary to analyze the change over a range of a specified size or 
number of pixels (typically a small size or number of pixels). 

[0077] The display processor 128 evaluates the changes in color or brightness to 
determine the outer perimeter of each of the elements displayed on the screen. In this 
way, the display processor 128 is able to determine the areas with no or with non-primary 
content. In yet another embodiment, the display processor 128 evaluates both the color 
and intensity of pixels to determine whether or not primary content exists in a pixel. 

[0078] Referring still to Figure 8, display processor 128 determines whether or not an 
area exists with non-primary content 808. If no such area exists, the display processor 
128 resizes the existing application windows comprising primary content to create an 
area with non-primary content 810. For example, the display processor 128 may execute 
an applications window restore method to cause the application to be non-maximized. 
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Once the area with non-primary content is detected or created, the display processor 128 
creates the content display, an attribute of the content display, such as the height, width, 
position, transparency or other attribute of the content display, the attribute associated 
with the size of the area of the display with non-primary content 812. The display 
processor 128 then causes the content display to be displayed in the area comprising non- 
primary content 814. 

[0079] If the display processor 128 detects multiple areas with non-primary content, 
the display processor selects the most appropriate area in which to create the content 
display. The appropriateness of an area may be determined based on a variety of factors. 
For example, in one embodiment, the display processor 128 selects the largest area with 
no content in which to create the content display. In another embodiment, the display 
processor 128 selects an area on the right or left side of the computer display to construct 
the content display. The relative appropriateness of various areas may be determined 
when the display processor is programmed or may be based on user-supplied preferences. 
For example, a user 1 12a may indicate a preference for a content display arranged 
vertically on the right-hand side of the screen. 

[0080] The display processor 128 may also vary the parameters of the displayed 
content depending on the available space. For example, in one embodiment, the display 
processor causes the content display to be semi-transparent so that a user can see an 
application executing behind the content window. 

[0081] The computer display 602 shown in Figure 7 provides an illustrative display 
on which the process shown in Figure 8 may operate. The display processor 128 first 
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identifies the layout of the screen and is able to determine the perimeter of the 
Application 1 window 604, the Application 2 window 606, and the toolbar 608. Based 
on the analysis, the display processor determines that the top section of the screen has an 
area with non-primary content 610. The display processor 128 then constructs a content 
display 702, the height, width, and position of the content display 702 based at least in 
part on the size and dimensions of the area with non-primary content 610. 

[0082] The information displayed in the content display 702 of Figure 7 may be 
generated in various ways in embodiments of the present invention. For example, in one 
embodiment, the information in the content display 702 is generated according to the 
method shown in Figure 2. Article identifiers from the messaging index 142 and from 
the article index 143 are displayed in the content display 702. The number of articles 
identifiers displayed and the layout of the sections of the content display 702 may vary 
according to the size of the content display 702 that is constructed. In one embodiment, 
the number of article identifiers displayed and the layout of the article identifiers within 
the content display 702 is affected by both the size of the content display 702 and by 
previously supplied user preferences. 

[0083] In one embodiment of the present invention, the set of article identifiers 
displayed or available in the content display may be refreshed periodically. Refreshing 
may occur, for example, substantially continuously, at pre-determined intervals, random 
intervals or upon events or inactivity (e.g., after a period of inactivity often minutes). In 
order to provide an effective, consistent, and non-distracting user interface to the user, the 
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display processor 128 according to one embodiment of the present invention reconstructs 
the results available or provided in the content display in various ways. 

[0084] Figure 9 is a flowchart illustrating a process of reconstructing a result set in 
one embodiment of the present invention. In the embodiment shown, the display 
processor 128 or query system 132 receives a trigger to refresh a result set displayed in 
the content display 902. The result set comprises a plurality of article identifiers. In 
response, the display processor 128 or query system 132 issues a request for a new 
updated result set 904. The request includes a search query. The search query may be 
identical to the search query issued for the result set currently displayed in the content 
display, or may vary based on user activity, the passage of time, or for some other reason. 

[0085] The display processor 128 transmits the search query in the request to a search 
engine. The search query may be sent to the search engine 122 on the client or the search 
engine 170 on the server device 104. The display processor receives a second result set 
in response to the query 906. The result set that is returned may be identical to the result 
set in the content display, may overlap somewhat, or may be completely different. 

[0086] The display processor 128 then creates a new, third result set that is based at 
least in part on the first result set and on the second result set 908. The display processor 
128 may create the third result set by modifying the first result set (e.g., adding, deleting, 
or moving article identifiers) or the second result set, or the display processor 128 may 
create an entirely different result set based on each of the first and second result sets. In 
one embodiment, the display processor compares the second result set to the first result 
set. For example, the display processor 128 may determine how many of the article 
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identifiers in the second set are different from the article identifiers in the first set. The 
display processor 128 may further determine the position of article identifiers that exist in 
both result sets. In the embodiment shown, the display processor sorts the results 
returned in the second result set based at least in part on the order of the results shown in 
the first result set. 

[0087] For example, if an article identifier exists in both result sets and is displayed 
in the third position in the currently-displayed result set and in the fourth position in the 
second result set, the display processor may move the article identifier to the third 
position in the second result set. In this way, the display processor 128 maintains 
consistency for the user 1 12a. Once the display processor 128 has sorted the second 
result set, the display processor 128 causes the new result set to be displayed in the 
content display 912. 

[0088] In another embodiment of the present invention, the display processor 128 
compares the two result sets and then replaces article identifiers in the currently displayed 
result set with article identifiers in the second result set. For example, if the third article 
identifier in the currently displayed list does not appear in the second result set, the 
display processor may replace the third article identifier with a newly-identified article 
identifier in the second result set. Such a process also helps to maintain consistency in 
the user interface for the user. In one embodiment, the display processor 128 is able to 
vary the rules for replacing results in the currently displayed result set based on actions 
by the user 1 12a. For example, if the user 1 12a does not click on or otherwise select or 
indicate an interest in a particular result after the result is displayed for a certain period of 
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time, the display processor removes the result from the displayed set, or places that result 
set in a lower position when it is included in future result sets. 

[0089] In one embodiment, the display processor 128 or query system 132 has a 
limitation on the number or percentage of results that can change, for example only 
allowing 2 results to be different in the new result set. Further, the system may have a 
minimum time period that it displays results for, and tries to avoid or never replaces 
results that have been displayed for less than the minimum time period. In one such 
embodiment, each result in the result set includes a display time measure that indicates 
the length of time that the result has been displayed. In one embodiment, the amount of 
change that is allowed in the result set is based on the current and past activity of the user 
1 12a. For example, during the time that the user 1 12a is working within a particular 
application, the amount of change allowed may be relatively low; whereas if the user 
1 12a switches to a new application, the amount of change may be higher or even 
unlimited. Activity of the user 1 12a may be used to alter the threshold. For example, 
navigating to a new page in a web browser may be an event where the amount of change 
allowed is greater. 

[0090] In another embodiments, the display processor 128 or query system 132 
considers additional result sets. For example, consider a first result set containing items 
A, B, and C; and a second result set containing items C, D, and E. One embodiment 
creates the new result set with item C in the same position as it was in the first result set, 
and replaces items A and B with items D and E. However, if the embodiment allows 
only changing one of the results, then the system must choose whether to replace A or B. 
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One such embodiment accomplishes this by considering additional earlier result sets, 
replacing the item that has been displayed for the longest time period. For example, if A 
has been in the result list for the last 30 seconds while B only appeared in the result set in 
the last second, the system replaces A. Such an embodiment provides consistency for the 
user 112a. 

[0091] Embodiments of the present invention may incorporate additional features as 
well. For example, in one embodiment of the present invention, the display processor 
128 supports a set of application programming interface (API) calls. In this embodiment, 
an application running on the client 102a, such as the web server, is able to call an API to 
display information according to an embodiment of the present invention, such as those 
exemplary methods set out above. The API may also provide the capability of formatting 
the result set in HTML, XML, or any other format required by the user. 

[0092] One embodiment of the present invention comprises an administration page. 
The user 1 12a clicks on an icon that provides access to the administration page. In one 
such embodiment, the user is able to set preferences for display, such as the minimum 
size of the window, the type of window to be displayed, the type of content to include, 
and various other parameters that may or may not relate to display, such as refresh rate, 
etc. 

[0093] The foregoing description of exemplary embodiments, including preferred 
embodiments, of the invention has been presented only for the purpose of illustration and 
description and is not intended to be exhaustive or to limit the invention to the precise 
forms disclosed. Numerous modifications and adaptations thereof will be apparent to 
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those skilled in the art without departing from the spirit and scope of the present 
invention. 
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